Skip to content

[ExecuTorch][WebGPU] Add fp32 matmul ops (mm, bmm, linear) to the WebGPU backend#20917

Open
JCNTH wants to merge 2 commits into
gh/JCNTH/56/basefrom
gh/JCNTH/56/head
Open

[ExecuTorch][WebGPU] Add fp32 matmul ops (mm, bmm, linear) to the WebGPU backend#20917
JCNTH wants to merge 2 commits into
gh/JCNTH/56/basefrom
gh/JCNTH/56/head

Conversation

@JCNTH

@JCNTH JCNTH commented Jul 14, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Stack from ghstack (oldest at bottom):

Add fp32 GEMM handlers (aten.mm, aten.bmm, aten.linear) — the dense matmuls the on-device training tail needs (tiled + vec4 WGSL).

Key changes:

  • runtime/ops/{mm,bmm,linear}/ — tiled + vec4 fp32 GEMM WGSL kernels + handlers
  • CMakeLists.txt WEBGPU_SRCS — wire the three sources

Reuses the shared Vulkan partitioner (aten.mm/bmm/linear already have Vulkan OpFeatures); this adds the WebGPU kernels only.

Co-authored-with: Claude Code.
@exported-using-ghexport

Differential Revision: D111755135

Differential Revision: D111755135

@JCNTH
Update
b572801 
[ghstack-poisoned]
@pytorch-bot

pytorch-bot Bot commented Jul 14, 2026 •
edited
Loading

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/20917

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 14, 2026
@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

This was referenced Jul 14, 2026
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
This was referenced Jul 14, 2026
Open
Open
Open
Open
Open
Open
Open
@JCNTH
Update
1e2758c 
[ghstack-poisoned]
SS-JIA
SS-JIA approved these changes Jul 16, 2026
View reviewed changes

@SS-JIA SS-JIA left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review automatically exported from Phabricator review in Meta.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@SS-JIA SS-JIA SS-JIA approved these changes
@larryliu0820 larryliu0820 Awaiting requested review from larryliu0820 larryliu0820 is a code owner
@kirklandsign kirklandsign Awaiting requested review from kirklandsign kirklandsign is a code owner

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. meta-exported

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@JCNTH @SS-JIA @nil-is-all